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ABSTRACT 

Early work on the topic of nonlinear input-output system modeling 
is due to Volterra. Moreover, Wiener's research on nonlinear system 
identification is quite well known. Recent papers by Koh and Powers on 
Volterra filtering and nonlinear system i dent if i cat i on and Boyd, Tang 
and Chua on measuring Volterra kernels have demonstrated the feasibility 
of obtaining "good 1 ' estimates of the first few kernels (especially the 

«5 o 

Hn first and second) of a Volterra series. However, the higher order terms 

0 O 

seem difficult to obtain for a variety of reasons. 
cry The purpose of this paper is to introduce a new technique for 

a identifying nonlinear systems, and we begin with a single input - single 
output system. Assuming the system is initially at rest, we calculate 
the first kernel (first convolution integral in the continuous case or 
^i^st convolution sum in the discrete case). We then obtain a 
controllable and observable linear realization in a particular canonical 
form. We probe the actual nonlinear system with an appropriate input 
(or inputs) and determine the output (or outputs). For the linear 
system we compute the input that produces the same output. In the 
difference between the inputs to the nonlinear and linear systems, we 
find basic information about the nonlinear system. There is an 
interesting class of nonlinear systems for which this type of 
identification scheme should prove to be acccurate. 


■^Research supported by the NASA Ames Research Center under Grant NAG 
2 - 366 . 


-i- 


NONLINEAR FILTER DESIGN 


1- Introduction 


Assume we have a system that can be probed with inputs to produce 
correspond ing outputs, which we record- We investigate the problem of 
identifying a nonlinear mathematical model of this physical system. For 
simplicity we take a deterministic approach (even though statistical 
techniques can be useful in our method) because we are interested in 
discovering information about the inherent mathematical structure in the 
systems. Moreover, we shall consider only the continuous time case for 
single-input single-output models. 

Most nonlinear system modeling techniques (including the work of 


Wiener [13) depend on the research of Voiterra [23 and the mathematics 
intrinsic in the Voiterra series and Voiterra kernels. Recent excellent 
references for Voiterra and Wiener theories are Fliess, Lamnabhi, and 
Lamnabhi-Lagarr igue C33 and Schetzen C43, respectively. Interesting 

i-i I« •vi-Unn i I- 1 1 « n *■ nri I 1 4-r r~ *-( K r~. -f n i nr rl "i v-> D n \ / f-t T'Vnn 


Chua [53 for the continuous time case and koh and Powers L63 for the 
discrete time case. All of the above research depends on the Lie 
algebra structure inherent in a nonlinear system. For an examination of 
this Lie algebra structure in realization theory we suggest a paper of 
Crouch [73. 

Recent papers in the area of nonlinear control have demonstrated a 
remarkable fact; many physical systems have mathematical models that are 
feedback equivalent to linear systems. References for the equivalence 
problem (in which the output equation is ignored) are [83, [93, [103, 
[113, C123, [133, [143, [153, [163. Applications are in the following 
various areas (many of the models are multi-input, mu 1 1 i -output ) 
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i) aircraft control. ^ POOR CP 5 ^^ 

i i ) robotics, 
in) satellite control, 
iv) chemical engineering, 
v) electric motor control. 

Authors have also investigated the problem of determining conditions 
under which a nonlinear system with output is feedback equivalent to a 
linear system with linear output (see [18] and [19]). 

The above facts suggest the following approach to nonlinear 
modeling. Instead of trying to identify Volterra kernels, why don’t we 
attempt to identify the nonlinear feedback that pushes our system toward 
a linear system? If a system is feedback equivalent to a linear system 
with linear output, we should obtain good results. If a system is not 
feedback equivalent, then we should obtain an "approximation” that is at 
least as good as the linear model obtained through standard techniques. 
However, the fact that so many physical systems have feedback equivalent 
(to a linear system) models is extremely encouraging. 

Our technique for identifying sing le-input , single-output nonlinear 


systems 

which 

are 

initially 

at rest 

is 

described as follows: 

1 ) 

Assume 

that the 

1 inear 

part 

of the 

system has been 


found 

and 

real i zed 

in 

control lable 

canonical form. 


Since 

we 

desire a 

minimum 

real ization 

here, we suppose 


that our state space realization is also observable. 

2) probe the nonlinear system with an input u producing 
an output y . Invert the 1 i near part of the system to 
find an input producing the same output y. 
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OWQB'WL PASS ?3 
OF POOR QUALITY 

3) read the states x = (x, , x_ 5 . . . 5 x ) of the linear 

13 n 

system or attach a Luenberger observer (or Kalman 
filter in the presence of noise). 

determine functions ohx) and /3( x > so that 

= oc( x ) + /3( x ) u 

for all inputs u> or more realistically? for an 

interesting finite subclass of probes u. 

Assuming that we obtain the linear part of a nonlinear system, the 

states x = <x 4 ?x_,...?x )? and the functions cx(x) and ,A( x ) ? we show 
1 2 n ' 

that the above technique yields excellent results for those systems 
having nonlinear mathematical models which are feedback equivalent to 
control labie and observable 1 i near systems having 1 1 rncir output 

In section 2 of this paper we consider the Volterra series 
approach? several examples? and prove a result concerning our 

i ben 1 1 f i c ct i x on technique. Section 3 con tains a discussion of fuluie 
directions and related problems. 

2. An Identification Technique 

We start with a state space representa t i on of a nonlinear system 
and derive a Volterra series expansion via the formulas found in [31. 
Our single-input, single-output nonlinear system is 

x(t) = f (x ) + ug(x)u 

(2.1) y ( t ) = h ( x ) 

where f and g are real analytic vector fields on \\P , h is a real 
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the origin. If dh denotes the gradient of h and <*,*> denotes 
duality of one forms and vector fields, then the Lie derivative 
with respect to f is 


L^h = <dh,f>. 


Similarly, we can define 


L h, ifh, = L(Lh), L 2 h, L Uh, L L h, etc. 
g f ff g gf fg 

The Volterra series for the system starting at the origin at 

t = 0 is 

,-t 


y ( t ,u) = 

(2.2) 


W 1 ( t ’ T 1 )u (T l )dT l 


r-t 


w^( t , t p » T^)u( T 1 Idr^dr, + . . 



pt 

-,T 



5 

T 


m m m 

•u 

0 L 

0 


Here 


"w i t j t i...ir)u(r \ rjar . 

55 Is 1 s 1 


, A _. r v o 

l 'o l '\ vt * \* i 1 

w (t,r ) = z L L L MO) , -j 

VV *6 1 ° 


'2, 


1 "0 


w 2 < t , , t'i ) = 


i 'o n i e (t 'V < v T i > r i 

L , L L. L L. h<0) T T r 

f g f q f i-u 1 l-\ 1 i-V - 


Vl' 2-0 


1 0 


(2.3) 


y s V 0 

is i ? v ( t-r ) . . . r 

"•'‘•v- x> Lf Vf -S L f 5h(0> ^rr^r- 

0 5“ 


Since f(0) = 0, we take all in the above summations to be 0. 


the 
of h 


time 
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Example g. 1 . We consider the 2-dimensional nonlinear system 


X. 




' 0 


1 

- 

2 

+ u 



m 


2 

l 




. x i 



2 





< 2 . 4 ) 


y = h ( x ) = x ^ . 


Computing some Lie derivatives we find L^L^.h(0) = 1 in 

w,(t,r,)) L L_L L^h(O) =2 in w (t,r ?r ) 

1 1 g f g f 2 2 1 

3 3 

and L L_L L^L L x h<0) = 4 in w_ ( t , 7_ , T- , r, ) . In fact we can find 
gfgfgf 3 321 

at least one nonzero term in each of w ,w , ... giving us an 

1 c 5 

infinite number of nonzero Volterra kernels corr espond i nq to an infinite 
dimensional Lie algebra structure associated with system (2.4). 

Suppose that we do not know system (2,4), but use linear analysis 
to identify the linear part of the system which is associated with the 
first Volterra kernel in (2.3). After realization in controllable 


r^nnnirAl fnrm wp h^v/p fho 1 ] hpat 


r . “i 

X , I 




' 0 

i 


2 



zz 


+ u 


V 

X _ i 


0 

L 

1 

2 j 




- 


(2.5) 


y = x x ■ 

For an input u into the nonlinear system we obtain an output 
y(t), which we assume is smooth. Substituting y(t) into (2.5) and 
differentiating we have 

y(t ) = x = x 2 
y ( t ) = x p = u^ . 
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Thus plugging u^ into the linear system yields the same output as 
substituting u into the nonlinear system. It is clear from (2.4) (if 

we knew such equations) that 

y(t) = Xj = x 2 
v ( t ) = ~ *1 + u ' 

. 2 
and u^ = x + u . 

We do know u,u^ and = y (the output of the linear system). 

2 

If we recognize that u^ - u = x^ for pairs of inputs u and , 
then we have identified the nonlinear system in an extremely easy 

manner. For example, the input u = 1 - - — into the nonlinear system 

corresponds to the input u^ = 1 into the linear system for producing 

2 4 2 

t t t 2 2 

the identical output — . Then u, - u = 1 - (1 - - — ) = ( - — ) = x, . 

d l h 2 i 

This illustrates the general procedure involving steps i ) — iv) 

that we mentioned in the introduction. 

The proceeding example is of mathematical interest. An example of 

a physical system for which our 4 step technique should prove useful 

is the single link manipulator with joint elasticity [17]. To conserve 

pages we shall not work out the details here. 

In step 4 of our technique we are to determine functions a( x ) and 

/3( x ) so that u^ = <x(x) + /3( x ) u. In our examples we have the special 

case that /3(x) = 1 and then identify a(x). 

It is well understood that for a controllable and observable linear 

2 

system of dimension n, there are n parameter that must be identified as 

is easily seen in a canonical form (either controllable or observable). 
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Let’s consider the possibility of a canonical form for a nonlinear 
system which is feedback equivalent to a controllable and observable 
linear system of dimension n. 

For feedback equivalence there are three types of operations 
involved : 

a) state space coordinate changes 

b) nonlinear feedback of the form u + «<x) 

c) space dependent input changes of the form /3<x)u» where 

,G(x) is nonvanishing. 

Most feedback equivalence results are local in nature, so we assume that 
ail discussions in this paper hold for some open neighborhood of the 


origin in state space. 

Suppose we consider the nonlinear system on IR” 


(2.6) 

X 4 


r ^ 

| X. j 


" 0 ; 


. 1 

X ... 

d 


i 8 

1 X 

d 


0 


y 

. n-1 

X 


V 

n , v 

a, x +a_x + -‘-a x +a(x) 

+ u 

n 

/3( x ) 


n 


112 8 n n 




y 


c i x i 


+ C 2 X 2 


+ . . 


+ C X 

n n 


h 


where «(x) and /3(x) are real analytic, /3(x) is nonvanishing with 
/3(C) = 1, and dh , dL^h , . . . , dL^! Vi are linearly independent. It is very 
easy to see that letting u^ = <x(x) + ,6(x)u, we have a controllable and 
observable linear system with controllable canonical form 
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(2.7) 


X . 


. 1 


*2 

— 

/■ 


X 


. n— 1 


X 


n j 



x 


' 0 

*3 


0 


+ U, 

■ 


L 

• 



0 

a x +a x + . . ,+a x 
112 2 n n 


i 


y = Cl x 1+ c 2 x a + ... + a n x p . 

Thus systems like (2.6) fit our technique for identifying nonlinear 
system which are feedback equivalent to linear systems having linear 
output . 

Theorem 2.1. A nonlinear system (2.1) which is feedback equivalent to a 
controllable and observable n-d imensi onal linear system (with linear 

output) can be put in the form (2.6). 

Proof: The state space coordinate changes c ) to move the 

i ^n 

dynamic equation 

x = f ( x ) + uq ( x ) 

from (2.1) in the direction of Brunovsky canonical form must satisfy the 

nar H a 1 Hi-F-fot-om-t-inl onuafi nr.c 


<d^»(ad f»g)> = 0, k = 0,1,..., n-2 


<d (ad f ,g ) > =0, k = 0,l,...,n-3 


(2.8) < d S' , , g > = 0 

"n-1 

<d? r f> ■ C a 

<d V f> - e 3 


<d 


f> = ■ 

1 
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(see C13]. Under such 


k 

Here (ad f ,g) is the usual Lie bracket notation 
coordinate changes equations (3.1) become 


(3.9) 


£ 


r t l 


0 



>3 


0 



t 

+ u 

0 

r 1 

n j 


aV+a 3 t+...+a ? +S( J;) 
1 ' 1 3 - 2 n - n 


f$(x) 


y = h(?) . 

The state space coordinate tr ansf ormat i ons £ = ( £ t , , . . . , f ) are not 

J "1 J 3 ‘*n 

unique. It is shown in [18] that if system (3.1) is feedback equivalent 
to a nonlinear system with linear g u t p ut, then at least one of these 
transformat ions gives us that linear output. Hence, with this choice, 
we can assume the output equation in (3.9) is y = + ...+ 


c £ . 
n "n 


If j6(0) = 1 , we have the desired form. 

1 . Anri 1 Pt 


Assume B(0) = r, r * 


1 4 
v _ — r - 

1 r *1 


(3.10) 


y - t. r 

3 r '2 


1_ ^ 


Then (2.9) becomes 


(2.11) 

' L 

V 

”2 

j 

j 

' *2 
* 3 

+ U 

i 

O o * * 1 

L_ 


x , 
.n-1 

X 

n 


X 

a ( x +a^x n +...+a x +«< x ) 

1 1 -J \-l 5 "1 V“\ 

L A A % — i— • 


0 

p( X ) 

L J 


y 


C 1 X 1 +C 3 X 3 + 


+c 

n 


x 

n 
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with ,0(0) = !. □ 

In example 2.1, if we attempt to identify the nonlinear system by 
our technique, the first step is to model the linear part of the system. 
Then we pursue the function oc( x ) , which is a function of the states of 
the linear system. 

However, consider the following diagram where NL denotes the 
nonlinear system, and L inverse is the inverse of the linear system 
(the linear part that we have identified). 



Figure 1 


Here u and y are the input and output of the nonlinear system, 

respectively. The function a is the difference of and u, but we 

have no need to identify it precisely. For example, suppose we are to 

stabilize the nonlinear system about the 0 equilibrium point. 

Choose a feedback matrix K = tk.,k_,...,k ] to stabilize the 

1 2 n 

linear part of the system and apply the following diagram, where L 
denotes the linear system. 



-1 1 









3. Related Problems 


The following discussion involves possible computer-aided methods 
for implementing the modeling technique introduced in the first two 
sections of this paper. 


Suppose we consider a physical system that we probe with a finite 
number of inputs and record the corresponding outputs. If we wish to 
model this system as an n^ order controllable and observable linear 
system? we first establish a criterion (usually least squares) for 
"closeness of match." We assume a model (e.g. controllable form) 



r v i 


! v 


0 


:i 


'‘2 




x^ 




0 


2 


3 



(3.1) 


= 

■ 

+ 

■ 


• 


■ 


* 


x 


X 


Q 


, n-4 


n 




X 


a*‘x +a_x +. . .+a x 


1 


L n j 


112 2 n n 




V - Vl^sV-'-^nV 


and compute the parameters a, ,a_,...,a »c, »c qivinq us a "best 

1c nid n " 

match . " 

Thus we have approximated our system by a linear model in canonical 
form. Since those nonlinear systems that are feedback equivalent to a 
linear system with linear output contain the linear systems as a proper- 
subclass, we use the identified linear model (3,1) as a first step in 
our more general process. We consider the "canonical form" 
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(3.2) 


' *1 
X 2 


■ x 2 
X 3 


‘ 0 
0 

. 

X- X* 

i 

L. 

1 

X 

n , , 

a„ x +a_x_+. . ,+a x +a(x) 
112 2 n n 

+ u 

— , 
X 

• . o £L 

i 


y = Vl +c 2V’” +c nV 


where a 5 c 4 5 c n ,...,c are known. 

12 n 1 2 n 

Invert the linear system (3.1) to obtain the finite number of 
corresponding inputs having the same outputs y as the nonlinear 

system with inputs u. Knowing the states x j 9 • . - > x p of the linear 
system, we set up a ’’closeness criterion” for computing a\>:) and fti x 5 
in u^ = a( x )+/3( x )u. Perhaps an appropriate method here is to assume 

that oc(x) and /3( x ) are in some standard set of functions; e.q. 
polynomials of degree m, 

T, 

(k) 


a( x ) = 


k | >1 


°(k) X 


|k’|>l H<k)A 


(k) 


Here we have used a multi-index notation for the coefficients a(x) and 

(ii x ) , and x = (x.,x n ,...,x ). For example we set 
1 2 n 


0(( X ) = oc, X .+OLX-+. . .+0t X +0£, X +0< „X,X +...+OS, x.x + 
11 22 nn 1,11 1,212 l,nln 


£ m 

o; x +oc x x +...+<x x . 

2,22 £,323 m,m,...,mn 


Plans are to set up simulation studies as well as prove results 
concerning the above method. 
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